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[57] ABSTRACT 

In a color image sensing system, a solid state image 
sensor has every four adjacent picture elements thereof 
grouped as one set, and combinations of color filters are 
arranged to cover almost all the picture elements of the 
image sensor. The color filters include first color filters 
which are arranged to pass a given color component for 
an obliquely adjacent pair of picture elements within 
each of the sets, and second and third color filters which 
are arranged to cover the other obliquely adjacent pair 
of picture elements within the same set. A signal com- 
posing circuit is arranged to receive the outputs of the 
solid-state image sensor, to form a signal corresponding 
to one of the picture elements having the first color 
filters by combining, in a given ratio, the output of this 
picture element and also those of other picture elements 
having the first color filters, and to form a signal corre- 
sponding to one of the picture elements having the 
second or third color filters by combining, in a given 
ratio, the outputs of the picture elements which have 
the first color filters and are disposed in the neighbor- 
hood of that picture element above, below and on the 
left and right sides of that picture element. 

36 Claims, 3 Drawing Sheets 
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color filters which arc arranged for the remaining two 
COLOR IMAGE SENSING SYSTEM picture elements of the same set respectively, the color 

filter combination being arranged to cover almost all 
This is a continuation application under 37 CFR 1.62 the picture elements of said image sensor; and lumi- 
of prior U;S. patent application Ser. No. 584,360, filed 5 nance signal composing means arranged to receive an 
Sep. 16, 1990, now abandoned. output of the solid-state image sensor, to form a signal 

which corresponds to one of the picture elements hav- 
BACKGROUND OF THE INVENTION ing the first filtcrs by combining in a given ratio an 

1. Field of the Invention output of this picture element with outputs of other 
This invention relates to a color image sensing system 10 picture elements having the first color filters and dis- 

of the kind using a solid-state image sensor. posed obliquely adjacent to this picture element and to 

2. Description of the Related Art form a signal which corresponds to one of the picture 
Many of the image sensing systems of the kind using elements having the second or third color filters by 

a solid-state image sensor such as a CCD, MOS or the combining in a given ratio outputs of picture elements 
like have been formed with a color mosaic filter, etc., 15 having the first color filters and disposed in the neigh- 
arranged in front of a single image sensor. borhood of that picture element in the lateral and verti- 
For example, they arc arranged as follows: Among cal directions. With the embodiment arranged in this 
the picture elements of the image sensor, every four manner, a luminance signal which corresponds to each 
mutually adjacent picture elements are grouped as one of the picture elements is composed of solely the out- 
set. For each of these sets, green (G) filters are allotted 20 puts of the picture elements covered by the first color 
to two obliquely adjacent ones of the picture elements, filters. 

a red (R) filter to one of the rest and a blue (B) filter to The above and other objects and features of the in- 
the other (a G-check, R and B method). This filter vention will become apparent from the following de- 
allotment is repeated for all the picture elements of the tailed description of an embodiment thereof taken in 
image sensor. With the picture elements arranged in this 25 connection with the accompanying drawings, 
manner, a luminance signal Y and color-difference sig- DESCRIPTION OF THE DRAWINGS 

nals R-Y and B-Y are composed from the outputs of the 

image sensor and formed into a color video signal. FIG. 1 is a block diagram showing an embodiment of 

In another known method, the filter colors to be this invention, 
allotted to each of the groups (sets) of four picture 30 FIGS. 2(a) to 2(e) are diagrams for explaining the 
elements of the image sensor are arranged to be white operation of the embodiment. 

(W), green (G), yellow (Ye) and cyan (Cy) or to be FIG. 3 is a block diagram showing the arrangement 
magenta (Mg), green (G), yellow (Ye) and cyan (Cy). of a luminance signal composing circuit 2. 

In forming, for example, a luminance signal in accor- DETAILED DESCRIPTION OF THE 

dance with the above-stated conventional method, 35 PREFERRED EMBODIMENT 

however, spurious resolution tends to be caused by the 

color of a picture-takinjg object or by the ratio of color FIG. 1 shows in a block diagram a color image sens- 
components of illumination light because the signal is ing system which is arranged according to this inven- 
composed of the outputs of the picture elements corre- tion as an embodiment thereof, 
sponding to a plurality of color filters. Under such a 40 Referring to FIG. 1, photo-electric conversion ele- 
condition, it is hardly possible to obtain an adequate ments (hereinafter referred to as picture elements) arc 
resolution. two dimensionally arranged. Every four mutually adja- 

In the case of the above-stated G-check, R and B cent picture elements are grouped as one set. A color 
method, for example, no luminance output is obtainable mosaic filter consists of, as shown in FIG. 2(a), filters W 
from the picture elements corresponding to the G and B 45 which allow all the color components (predetermined 
filters in taking a picture of a red object. Then, in the color components) of light to pass, filters which are for 
horizontal direction of the image sensor, the luminance red (R) and filters which are for blue (B), The color 
output is obtainable only from one of every two picture mosaic filter is arranged to allot the filters W to one of 
elements. This is equivalent to a decrease in the sam- the two obliquely adjacent pairs of picture elements 
pling frequency and thus increases the possibility of 50 included in each of the above-stated sets of four picture 
spurious resolution. Other methods mentioned above elements, to allot the filter R to one of the other 
also present the same problem. obliquely adjacent pair of picture elements and to allot ! 

the filter B to the other of the pair. The solid-state image 
SUMMARY OF THE INVENTION sensor is arranged to permit the outputs of the four 

this invention is directed to the solution of the 55 picture elements to be simultaneously read out from 
above-stated problem of the prior art. It is, therefore, an four output lines. Further, this color mosaic filter is 
object ofthe invention to provide a color image sensing repeatedly arranged to cover almost all the picture 
system which is capable of giving a color video signal elements except black reference picture elements and 
without any excessive spurious resolution. dummy picture elements. A luminance signal compos- 

To attain the above-stated object, a color image sens- 60 ing circuit 2 is arranged to form a luminance signal Y 
ing system arranged according to this invention as an from the two W outputs which are included in the four 
embodiment thereof comprises: a solid-state image sen- outputs of the solid-state image sensor LAG matrix 
sor arranged to group every mutually adjacent four circuit 3 is arranged to form a green signal G from the 
picture elements as one set among the picture elements outputs R and B ofthe solid-state image sensor 1 and the 
ofthe image sensor, to be provided with a combination 65 output of the luminance signal composing circuit 2. A 
of color filters including first color filters which pass a processing circuits is arranged to perform gamma cor- 
given color component for an obliquely adjacent pair of rection, white clipping, black clipping, color difference 
picture elements of each ofthe sets and second and third matrix processes, etc.. An encoder 5 is arranged to per- 
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form balanced modulation and synchronizing (sync) arc arranged to delay the input signal for a period of 
signal adding processes. An output terminal 6 is ar- time corresponding to two picture elements. Reference 
ranged to output a video signal. An object image which numerals 10, 11 and 12 denote coefficient circuits re- 
is not shown is formed on the photo-electric conversion spectively. A numeral 13 denotes one-picture-element 
plane of the solid-state image sensor 1 through a lens 5 delay line which is arranged to delay the input signal for 
which is not shown and the color mosaic filter which is a period of time corresponding to one picture element, 
arranged as shown in FIG. 2(a). Then, electrical signals A numeral 14 denotes a switch circuit. Numerals 15 to 
Wl, B t R and W2 are output from the terminals 1-1, 1-2, 19 denote adders respectively. 

1-3 and 1-4 of the image sensor 1. The input signal Wl is delayed by the one-H delay 

FIG. 2( e) shows the output lines of the solid-state 10 line 7. The input signal Wl is supplied also to the adder 
image sensor from which the output of the picture ele- 15 without being delayed. The adder 15 adds together 
merits are obtained . In FIG. 2(e). a reference numeraTl the delayed signal Wl and the non-delayed signal Wl. 
denotes the outputs of the picture elements to be ob- The output of the adder 15 is supplied to the two-pic- 
tained from the output terminal 1-1 of the solid-state ture-element delay line 9 and to the adder 18. The out- 
image sensor 1. Numerals 2, 3 and 4 likewise denote the 15 put of the adder 15 is thus delayed by the delay line 9 
outputs of the picture elements to be obtained from the and the delayed signal is added to the non-delayed sig- 
output terminals 1-2, 1-3 and 1-4 of the image sensor. nal by the adder 18. The coefficient circuit 10 then 
Of these outputs, the signals Wl and W2 are con- multiplies the output of the adder 18 by |. Meanwhile, 
verted into a luminance signal Y by the luminance sig- the input signal W2 is delayed for a period of time cor- 
nal composing circuit 2. The signals R and B and the 20 responding to two picture elements by the two-picture- 
output Y of the luminance signal composing circuit 2 element delay line 8, and then the coefficient circuit 11 
are supplied to the G matrix circuit 3 to be converted multiplies the output of the delay line 8 by J. The out- 
into a green signal G. These signals Y, R, G and B are puts of the coefficient circuits 10 and 11 are added to- 
supplied to the processing circuit 4 to be subjected to gether by the adder 19. As a result, the signal "b" which 
various processes including the gamma correction, etc. 25 is shown in FIG. 2(b) is obtained. Further, the output of 
As a result of these processes, a luminance signal Y2 and the adder 15 is supplied also to the adder 17. Mean- 
color-difference signals R-Y and B-Y are formed. These while, the adder 16 adds together the non-delayed sig- 
signals Y2, R-Y and B-Y are supplied to the encoder 5 nal W2 and the signalW2 which is delayed by the two- 
to be converted into a video signal by the encoder 5. picture-element delay line 8. The adder 17 adds to- 
The video signal thus formed is output from the video 30 gether the output of the adder 15 and that of the adder 
output terminal 6. 16. The coefficient circuit 12 then multiplies the output 

FIGS. 2{a) to 2(e) are diagrams for explaining the of the adder 17 by I The output of the coefficient co- 
operation of the luminance signal composing circuit 2 of cuit 12 is delayed by the two-picture-element delay line 
FIG. 1. Of these drawings, FIG. 2(a) shows the color 20. As a result, the signal M c" which is shown in FIG. 
allocation of the color mosaic filter on the solid-state 35 2(c) is output from the delay line 20. The signal "b" is 
image sensor 1. As mentioned in the foregoing, four supplied to the one-picture element delay line 13 to be 
picture elements are grouped as one set. For each of delayed for a period of time corresponding to one pic- 
these four-picture-element sets, the filters W are allotted ture element. The delayed signal "b" is supplied to the 
to two of the picture elements which are obliquely switch circuit 14. The signal "b" or "c" is then output as 
adjacent to each other. The red filter R is allocated to 40 the luminance signal Y through a switch-over action 
one of the remaining two picture elements and the blue performed on the signals "b" and "c" by the switch 
filter B to the other of the remaining two picture ele- circuit 14. 

ments. FIG. 2(b) shows a matrix for composing the In the case of this embodiment, the luminance signal 
luminance signal. FIG. 2(c) shows another matrix for for each of the picture elements of the solid-state image 
composing the luminance signal Referring to FIGS. 45 sensor 1 is thus composed of only the outputs of the 
2(6) and 2(c), each of these 3x3 matrixes is arranged to picture elements that are covered with the first color 
form an output corresponding to the central picture filters which pass all colors. The possibility of the spuri- 
element by interpolating four or five picture elements ous resolution can be reduced by this. 
FIG. 2(d) shows how the matrixes of FIGS. 2(6) and Since the luminance signal of each specific picture 
2(c) are allotted to each picture element In other words, 50 element is obtained oh the basis of an output obtained 
a reference symbol "b" denotes that the matrix of FIG. through the first color filters of picture elements located 
2(6) is used in composing the luminance signal for a obliquely adjacent to the specific picture element, the 
picture element "b** by using a total of five picture embodiment is capable of adequately coping with a 
elements including this picture element "b" and change of luminance obliquely taking place relative to 
obliquely adjacent picture elements which are disposed 55 the picture element. 

above and below this picture element "b" in accordance Further, the manner in which the luminance signal Y 
with the matrix of FIG. 2(6). A reference symbol "c" is composed by the embodiment is not limited to the 
denotes that the matrix of FIG. 2(c) is used in compos- method shown in FIG. 3. It can be changed to any 
ing the luminance signal of a picture element "c" by manner that gives the matrixes shown in FIGS. 2(6) and 
using a total of four picture elements which are disposed 60 2(c). For example, it is changeable as follows: A total of 
on the right and left sides of and above and below that six signals are formed, including a signal which is ob- 
picture element "c" according to the matrix of FIG. tained by delaying the signal Wl for the period of 1 H; 
2(c). a non-delayed signal Wl; signals which are obtained by 

FIG. 3 shows by way of example the arrangement of delaying these signals for a period of time corrcspond- 
the luminance signal composing circuit 2 of FIG. 1. 65 ing to two picture elements respectively; a signal which 
Referring to FIG. 3, a one-H delay line 7 is arranged to is obtained by delaying the signal W2 for the period of 
delay the input signal for one horizontal period of the time corresponding to two picture elements; and a non- 
TV signal. Two-picture-element delay lines 8, 9 and 20 delayed signal W2. Then, these signals are multiplied by 
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the coefficients which are shown in FIGS. 2(b) and 2(c) 
respectively before they are added together. The coeffi- 
cient values of the matrixes are not limited to those 
shown in FIGS. 2(b) and 2(c). In place of them, other 
suitable coefficient values may be used for multiplying 5 
the signals of the picture elements located in the posi- 
tions corresponding to the filters W within the 3x3 
matrix to obtain the luminance signal Y. 

Further, the coefficient values of the matrixes are 
selected as follows: The total (J) of the coefficient val- 10 
ues of the first column, the total (J) of the coefficient 
value of the second column, the total (\) of the coeffici- 
ent values of the third column, the total (J) of the coeffi- 
cient values of the first row, the total (J) of the second 
row and the total (i) of the third row of FIG. 2(b) 15 
coincide with those of the corresponding coefficients of 
FIG. 2(c). By this, the occurrence of the spurious reso- 
lution can be minimized. The matrixes are not limited to 
the 3x3 matrixes and can be prepared to be 4x4 or 
5 X 5 or larger matrixes as long as the sums of cone- 20 
sponding columns and those of corresponding rows of 
the two matrixes coincide with each other. Further, it 
goes without saying that the signals output from the 
output terminals 1-1 to 1-4 are stored in a digital field 
memory after they are temporarily A/D (analog-to- 25 
digital) converted; and the adding operations of FIGS. 
2(b) and 2(c) are carried out when these signals are read 
out from the memory. 

The embodiment described is arranged to form the 
luminance signal Y from the output signals Wl and W2. 30 
However, this arrangement may be changed as follows: 
A high-band luminance signal is formed by causing a 
high-frequency portion above 0.5 to 2 MHz or there- 
about of the above stated luminance signal composition 
output which relates to the spurious resolution to pass 35 
through a high-pass filter. A low-band luminance signal 
is formed by causing a low-frequency portion of the 
luminance signal composition output which is lower 
than the high-band to pass through a low-pass filter. It 
is also possible to obtain the low-band luminance signal 40 
by forming a luminance signal forming matrix in accor- 
dance with the signals R, G and B shown in FIG. 1, i.e., 
Y =0.3 R+ 0.59 G+0.11 B before it is passed through 
the low-pass filter. After that, the high-band luminance 
signal and the low-band luminance signal are added 45 
together to obtain the luminance signal Y. Further, the 
delay lines which are arranged to delay inputs for peri- 
ods of time corresponding to one picture element and to 
two picture elements as shown in FIG. 3 may be re- 
placed with sample-and-hold circuits. 50 

While the embodiment is arranged to obtain the lumi- 
nance signal of each of the picture elements, it is possi- 
ble to obtain a signal for a specific color component of 
each picture element by preparing the first filter for the 
specific color. 55 

As described in the foregoing, the color image sens- 
ing system arranged according to this invention is capa- 
ble of giving a color video signal with a less degree of 
spurious resolution by virtue of the solid-state, image 
sensor which is provided with a combination of a plu- 60 
rality of color filters. 
What is claimed is: 

1; An image sensing system comprising: . 

a) image sensing means having picture elements ar- 
ranged in columns and rows; 65 

b) color separation filter means including first color 
filters which allow a luminance component to pass 
and are arranged for every other picture element 



6 

both in the directions of columns and rows and at 
least second color filters which are arranged for 
remaining picture elements in a predetermined 
repetitive pattern; and 
c) luminance signal forming means for forming a 
luminance signal, said luminance signal forming 
means being arranged such that, in forming said 
luminance signal corresponding to a specific first 
one of picture elements which are provided with 
said first color filters, the luminance signal is 
formed by using at least signals of a plurality of 
picture elements located obliquely adjacent to said 
specific first picture element and a signal of said 
specific first picture element and, in forming said 
luminance signal corresponding to a specific sec- 
ond one of picture elements which are provided 
with said second color filters, the luminance signal 
is formed by using signals of a plurality of picture 
elements located adjacent to said specific second 
picture element in the vertical and horizontal direc- 
tions. 

2. A system according to claim 1, wherein said first 
color filters are colorless filters. 

3. A system according to claim 1, wherein said sec- 
ond color filters include red filters. 

4. A system according to claim 1, wherein said sec- 
ond color filters include blue filters. 

5. A system according to claim 1, wherein said sec- 
ond color filters include red filters and blue filters. 

6. A system according to claim 5, wherein said red 
filters and blue filters are arranged on every other row 
respectively. 

7. A system according to claim 1, wherein said lumi- 
nance signal forming means includes delay means. 

8. A system according to claim 7, wherein said delay 
means includes a field memory. 

9. A system according to claim 7, wherein said delay 
means includes a one : H memory. 

10. An image sensing system comprising: 

a) image sensing means having picture elements ar- 
ranged in columns and rows; 

b) color separation filter means including first color 
filters which allow a luminance component to pass 
and are arranged for every other picture element 
both in the directions of columns and rows and at 
least second color filters which are arranged for 
remaining picture elements in a predetermined 
repetitive pattern; and 

c) luminance signal forming means for forming a 
luminance signal, said luminance signal forming 
means being arranged such that in forming said 
luminance signal corresponding to a specific first 
one of picture elements which are provided with 
said first color filters, the luminance signal if 
formed by using at least signals of a plurality of 
picture elements located obliquely adjacent to said 
specific first picture element and a signal of said 
specific first picture element. 

11. A system according to claim 10, wherein said first 
color filters are colorless filters. 

12. A system according to claim 10, wherein said 
second color filters include red filters. 

13. A system according to claim 10, wherein said 
second color filters include blue filters. 

14. A system according to claim 10, wherein said 
second color filters include red filters and blue filters. 
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15. A system according to claim 14, wherein said red 
filters and blue filters are arranged on every other row 
respectively. 

16. A system according to claim 10, wherein said 
luminance signal forming means includes delay means. 5 

17. A system according to claim 16, wherein said 
delay means includes a field memory. 

18. A system according to claim 16, wherein said 
delay means includes a one-H memory. 

19. An image sensing system comprising: 10 

a) image sensing means having picture elements ar- 
ranged in columns and rows; 

b) color separation filter means including first color 
filters which allow a luminance component to pass 
and are arranged for every other picture element 15 
both in the directions of columns and rows and at 
least second color filters which are arranged for 
remaining picture elements in a predetermined 
repetitive pattern; and 

c) luminance signal forming means for forming a 20 
luminance signal, said luminance signal forming 
means being arranged such that, in forming said 
luminance signal corresponding to a specific sec- 
ond one of picture elements which are provided 
with said second color filters, the luminance signal 25 
is formed by using signals of a plurality of picture 
elements located adjacent to said specific second 
picture element in the vertical and horizontal direc- 
tions. 

20. A system according to claim 19, wherein said first 30 
color filters are colorless filters. 

21. A system according to claim 19, wherein said 
second color filters include red filters. 

22. A system according to claim 19, wherein said 
second color filters include blue filters. 35 

23. A system according to claim 19, wherein said 
second color filters include red filters and blue filters. 

24. A system according to claim 23, wherein said red 
filters and blue filters are arranged on every other row 
respectively. 40 

25. A system according to claim 19, wherein said 
luminance signal forming means includes delay means. 

26. A system according to claim 25, wherein said 
delay means includes a field memory. 

27. A system according to claim 25, wherein said 45 
delay means includes a one-H memory. 

28. A system according to claim 19, wherein said 
luminance signal forming means is arranged to form 
said luminance signal by using signals of picture ele- 

50 



ments disposed horizontally and/or vertically adjacent 
to each of said picture elements which are provided 
with said second color filters. 
29. A color image sensing system comprising: 

a) a solid-state image sensor which has every four 
mutually adjacent picture elements thereof 
grouped as one set and is provided with combina- 
tions of color filters including first color filters 
which are arranged to pass a given color compo- 
nent for an obliquely adjacent pair of picture ele- 
ments within each of said sets and second and third 
color filters which are arranged to cover the re- 
maining obliquely adjacent pair of picture elements 
of said set, said image sensor being arranged to 
have almost all picture elements thereof covered 
with said combinations of color filters; and 

b) signal composing means arranged to receive an 
output of said solid-state image sensor and to form 
a signal corresponding to one of the picture ele- 
ments for which said first color filters are provided 
by combining, in a predetermined ratio, an output 
of said one picture element and outputs of a plural- 
ity of picture elements which are provided with 
said first filters and are disposed obliquely adjacent 
to said one picture element, and to form a signal 
corresponding to one of the picture elements for 
which said second or third color filters are pro- 
vided by combining, in a predetermined ratio, out- 
puts of a plurality of picture elements which are 
provided with said first color filters and are dis- 
posed in the neighborhood of said one picture ele- 
ment above, below and on the right and left sides 
thereof. 

30. A system according to claim 29, wherein said first 
color filters are colorless filters. 

31. A system according to claim 29, wherein said 
second color filters include red filters. 

32. A system according to claim 31, wherein said 
third color filters include blue filters. * 

33. A system according to claim 32, wherein said red 
filters and blue filters are arranged on every other row 
respectively. 

34. A system according to claim 29, wherein said 
signal composing means includes delay means. 

35. A system according to claim 34, wherein said 
delay means includes a field memory. 

36. A system according to claim 34, wherein said 
delay means includes a one-H memory. 

♦ * * * ♦ 
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